CLAIMS 



What is claimed is: 




l| 1. A multi-processor computer ^ystem, comprising: 

a plurality of processors, each processor coupled to at least one memory cache, one cache 

3 ^control unit, and one interprocessor router; 

4 ' a memory coupled to /each processor, each memory managed by a memory controller 

5 configured to accept memory requests from the plurality of processors; and 
& s at least one input/output device coupled to at least one processor; 

If, wherein the memow requests from a local processor are delivered to the memory controller 

6 by the cache control unit/and wherein memory requests from other processors are delivered to the 
M memory controller by the interprocessor router and wherein the memory controller allocates the 
15 memory requests in a shared buffer using a credit-based allocation scheme . 



til 



f t 2. The computdr system of claim 1 wherein: 

the cache control unit and the interprocessor router are each assigned a number of credits; 
at least one of said credits must be delivered by the cache control unit to the memory 
controller when a/memory request is delivered by the cache control unit to the memory controller; 
and 

at least /me of said credits must be delivered by the interprocessor router to the memory 
controller wheh a memory request is delivered by the interprocessor router to the memory 
controller; 

wherejn if the number of filled spaces in the shared buffer is below a threshold, the buffer 
1 0 returns the cr< :dits to the source from which the credit and memory request arrived. 
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3. The computer system of claim 2 wherein: 

wherein if the numberlof filled spaces in the shared buffer is above a threshold, the buffer 
holds the credits and returns a credit in a round-robin manner to a source from which a credit has 
been received only when a space in the shared buffer becomes free; and 

wherein if a source hEfs no available credits, that source cannot deliver a memory request to 
the shared buffer, 

4. The computer system of claim 2 wherein: 
the number of credits assigned to the cache control unit and the interprocessor router is 

sufficient to enable each source to deliver an uninterrupted burst of memory requests to the buffer 
without having to wait for credits to return from the buffer. 



5. The computer system of claim 4 wherein: 

the number of credits available in the cache control unit and the interprocessor router are 
stored and updated in counters located in the cache control unit and the interprocessor router; and 

the number of < redits spent by the cache control unit and the interprocessor router are 
stored and updated in counters located in the shared buffer. 

6. The computer system of claim 4 wherein: 

the threshold is the point when the number of free spaces available in the buffer is equal to 
the total number of cred: ts assigned to the cache control. unit and the interprocessor router. 
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1 7. A computer processor for use inja multi-processor system, comprising: 

2 an associated memory; 

3 a memory controller comprising a request buffer in a front-end directory in-flight table; 

4 an L2 data cache; 

5 an L2 instruction and data Jbache control unit configured to send request and response 

6 commands from the processor to the memory controller; 

7 at least one input/output device coupled to the processor; and 

gt an interprocessor and I/O pouter unit configured to send request and response commands 

01 from other processors to the memjbry controller; 

lfcf wherein the L2 instruction and data cache control unit and interprocessor and I/O router 

1 ? J; unit are assigned a number of credits and are configured to give up a credit to the directory in-flight 

\1 table each time a request or response command is sent to the request buffer and wherein if the 

JS.S. I 

l| request buffer is filled below k buffer threshold, the directory in-flight table immediately returns 

W credits to the source from which the credit was received. 
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8. The computer processor of claim 7 wherein: 

if the request buffer! is filled above a buffer threshold, the directory in-flight table holds 
credits and returns a credit tp a source from which a credit was received only when a buffer space 
is emptied; and 

wherein if a source las no available credits, that source may not send a request or response 
command to the request bi ffer and wherein if a source has one available credits, that source may 
only send a response command to the request buffer. 
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1 9. The computer processor of claim 8 wherein: 

2 the credits are returned to the sources which have given up credits to the directory in-flight 

3 table in a random, equally probably manner. 
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1 0. The computer processor jof claim 8 wherein: 
the buffer threshold is ifhe point above which the number of empty spaces in the request 

buffer is equal to the total num ?er of credits assigned to the L2 instruction and data cache control 
unit and interprocessor and I/Olrouter. 

1 1 . The computer processor of claim 8 wherein the directory in-flight table further comprises: 

a counter to store anc update the number of credits spent by the L2 instruction and data 
cache control unit; 

a counter to store arj< 
router; and 

a counter to store aifid update the number of empty spaces in the request buffer when the 
request buffer is filled abovfe the buffer threshold; 

wherein when the request buffer is filled above the buffer threshold, the directory in-flight 
table holds credits and returns credits only when the number of empty spaces in the buffer 
increases. 



d update the number of credits spent by the interprocessor and I/O 



1 12. The computer pro 

2 the number of c 



;essor of claim 8 wherein: 

edits available to the L2 instruction and data cache control unit and 
3 interprocessor and I/O rohter is stored and updated by counters in each unit. 
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1 3 . The computer processor of claim 8 wherein: 

the number of credits available to the L2 instruction and data cache control unit and 
interprocessor and I/O router isj determined by the round trip time required to send a credit to and 
receive a credit from the directory in-flight table; 

wherein the number of credits given to each source is sufficient to allow each source to 
send an uninterrupted sequence of request or response commands to the directory in-flight table 
without delays caused by waiting for credits to return from the directory in-flight table. 



1 4. A method of allocati 



assigning credits to 



paying the credit back to tl 
wherein if the nun 



lg space in a shared buffer, comprising: 



ach source that sends data packets to the shared buffer; and 
requiring each souijce to spend a credit each time that source sends a data packet to the 
shared buffer; 

wherein if the num >er of empty buffer spaces is larger than a buffer threshold, immediately 
e source from which the credit and data were sent; and 
ber of empty buffer spaces is smaller than the buffer threshold, holding 
the credit until a buffer sp^ce becomes empty and then paying a credit back to a source from which 
a credit was sent. 



when the number 



space becomes empty, re 
sources which have spent 



1 5 . The method of claim 1 4, wherein: 

)f empty buffer spaces is smaller than the buffer threshold and a buffer 
urning a credit in a random, equally probably manner to one of the 
credits held by the buffer. 
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1 16. The method of claim w, wherein: 

2 when the number of pnpty buffer spaces is smaller than the buffer threshold and a buffer 

3 space becomes empty, returning a credit in a random, statistically skewed manner to one of the 

4 sources which have spent cijedits held by the buffer. 

1 1 7, The method of claim 14, further comprising: 

1% assigning a minimum number of credits to each source that is sufficient to allow each 

CB source to send a continuous sequence of data packets without waiting for returned credits. 

f Tr= / 

f Jl 18. The method of maim 14, further comprising: 

f»2 preventing a squrce from delivering a data packet to the shared buffer if that source has no 

Up available credits. 

1 19. The method if claim 1 4, further comprising: 

2 setting the buffer threshold equal to the number of total credits assigned to all the sources. 



1 20. The method of claim 14, further comprising: 
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using a coi 



spent and paid bac : credits. 



iter in each source and a counter for each source coupled to the buffer to track 
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